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Abstract: 

Three  new  iterative  calculations  which  converge  to  the  ratio  matrix  of 
the  discrete  generalized  geometric  distribution  are  presented  for  queueing 
systems  having  this  limiting  distribution.  Two  criteria  for  convergence 
are  provided. 
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In  many  congestion  systems  a  single  queue  of  customers  is  processed 
by  a  complex  service  system.   Because  only  some  components  of  the  service 
system  are  in  use  and/or  a  finite  number  of  jobs  are  partially  processed, 
the  service  system  can  be  in  any  one  of  m  states  (m<») ,  The  natural 
stochastic  model  uses  a  two  dimensional  state  of  the  system  variable 
N(t)  *  (N..(t)s  N7(t))  with  N..  measuring  the  number  of  jobs  in  the  system  and 
N?  identifying  which  of  the  m  possibilities  is  the  current  condition  of  the 
service  system.  AX  though  the  process  can  be  considered  in  continuous  time 
and  made  Markovlan  by  adding  an.  appropriate  number  of  continuous  supplementary- 
variables  [3,4],  here  only  an  approximating  discrete  time  discrete  state  chain 
will  be  considered.  This  assumption  simplifies  both  notation  and  analysis  but 
probably  is  immaterial  for  modeling  uses  especially  if  discrete  supplementary 
variables  are  used  when  appropriate.   It  is  further  assumed  that  jobs  are 
processed  individually  with  the  time  interval  chosen  small  enough  so  that  at 
most,  one  event,  job  arrival,  job  departure,  or  change  of  processing  condition 
occurs  with  a  significant  probability  in  a  single  interval.  This  means  that 
the  transition  operator  of  the  process  is  non  zero  only  for  states  differing 
by  at  most  1  in  N.  .   Finally  it  is  assumed  that  for  all  values  of  N-  from  some 
point  on  the  transition  structure  is  constant-  in  this  variable.   Qualitatively, 
this  is  equivalent  to  allowing  various  adjustments  to  the  load  when  few 
customers  are  in  the  system,  but  once  the  system  is  sufficiently  congested  no 
further  adaptation  is  possible.   Letting  P±(t)  be  the  vector  of  probabilities 
of  the  m  states  for  which  Nn  a   i  for  i  sufficiently  large  (i>i*)  the  chain 
satisfies 
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Pi(t+1)  -  P1_1(t)U  +  P±(t)(I+B)  +  P1+1(t)D 

for  matrices  of  probabilities  U,  I+B,  and  D  (I  is  the  identity  matrix).   It 
is  assumed  that  all  states  communicate.  Moreover ,  D+I  +  B  +  Dis  the  matrix 
of  an  m  state  irreducible  acyclic  chain.  Finally,  there  is  a  k  such  that 
the  sum  of  ail  k  term  products  of  the  matrices  U.  I+B,  and  D  such  that  the 
numbers  of  D's  is  the  same  as  the  number  of  U's  and  the  cumulative  numbers 
of  D's  in  the  partial  products  is  the  same  or  less  than  the  number  of  U's, 
is  a  strictly  positive  matrix.  This  means  there  is  some  sequence  of 
transitions  from  any  state  for  which  N  =  i  to  another  state  for  which 
N.  =  i  though  states  for  which  N,  >_  i.   In  [4]  it  was  shown  that,  if 
they  exist,  the  limiting  probabilities  for  this  system  are  geometric  in 
the  upper  tail.  Let  P.  "  limit  P.  (t).  For  i  >_  i* 

Pl  *  Pi-lUZ 

where  Z  is  a  matrix  of  the  expected  number  of  visits  starting  from  a  state 
in  set  i  to  other  states  in  set  i  through  states  with  N-  >_  i.  The  matrix  Z 
is  strictly  positive  (>>0)  and  can  be  computed  iteratively  from 

(1) 


Z  =  -B~1(I+UZ  ,DZ  .) 
n  n-1  n-l 


and  satisfies 


(2)       I  +  BZ  +  UZDZ  -  Q 


Even  in  the  previous  discussion  possible  simplification  of  the  calculation 
because  of  degeneracy  was  considered.   In  earlier  work  [1]  an  alternative 
iteration  was  developed  under  the  special  assumption  U  *  XI  for  a  number 
X.     In  both  cases,  non  degenerate  limiting  probabilities  were  assumed  to 
exist.  A  condition  for  the  existence  of  limiting  probabilities  in  the 
special  case  was  proved  [2].  This  paper  extends  this  condition  to  the 
more  general  situation  and  relates  this  condition  to  the  limiting  proba- 
bilities.  In  addition,  alternative  iterative  calculations  for  the  matrix 
are  established. 

Q  Iteration 

Define  the  two  iterative  schemes 


Q  =  WP 


(3) 


On  "  <U+<^-i  EM'5"1) 


* 

Q  -  0 
o 


(4) 


*       *  2      -1 
On  =  (U+Vl  D)  ("B  } 


The  row  vector  P  is  strictly  positive,  W  is  a  non  negative  column  vector, 
and  the  scalar  product  (P,W)  =  r  >  0.  The  vectors  P  and  W  satisfy 

(5)  P(lH-FB+r2D)  -  0 

(6)  (U+rB+r2D)W  «  0 

The  number  T   is  the  smallest  positive  number  for  which  there  is  a  P  >>  0 
satisfying  (5).   Both  schemes  converge  to  the  same  limit.   The  limit  has  a 
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strictly  positive  i  th  row  if  there  is  a  positive  entry  in  the  i  th  row  of  U. 
The  limit  has  eigenvector  P  and  eigenvalue  T. 

The  communication  assumption  implies  that  I  +  B  is  not  conservative 

~3         k  -1 

and  thus  -B   =  E(I+B)   exists.   The  non  negativity  of  U,  D  and  -B   means 

that  by  induction  0  >  0  ,  and  Q  >  Q   .   In  addition  an  induction  starting 

•n  —  -n-1     ^n  —  Nn  6 

from  PQ  -  PWP  =  PP  proves  PQ  *  IP,     This  follows  because 

PQ  »  P(U+Q2  .  D)(-B-1) 
^n      ^n-1 

-  PCu+r^x-B"1) 


Using  (5) 


PQ  =>  P(-rB)(-B"1)  -  rp 

Q 


Since  P  is  strictly  positive  this  implies  that  the  coordinates  P  and  P 

satisfy 

P  Q      <  I   P,  Q  ,    -  TP 
r  Tft,r,s  —  .   k  n,k,3     s 

From  this  the  matrix  entries  Q     satisfy 

n,r,s      ' 

Q      <  r  max  P  /P  <  <» 
Ti,r,s  —       s  r 

'      rs 

* 
Since  Q  >  0,  Q      is  bounded  and  therefore  Q      is  bounded.   This  and 
n  —     nsr,s  Hr.,rfs 

■k  * 

the  monotonicity  of  Q     imply  that   the   sequence  Q     converges   to  a  finite 

ft 

limit  Q   . 

ft  k 

Notice  that  Q  includes  all  products  of  matrices  of  the  form  U(I+B)". 

Q2  includes  Che  additional  products  of  terms  of  the  form  U(l+B)*l  U(I+B+)  2 

k  *  k 

D(I+B)  3.   Generally  Q  includes  all  products  of  terms  of  the  form  U(I+B)  1 
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U(I+B)k2  D(I-i-B)k3  U(I4-B)k4... which  include  at  most  n-1  D's.   All  products 
begin  with  a  U  and  the  number  of  D!s  is  one  less  than  the  number  of  U's. 

£         ft     ft 

Rewriting  Q  as  OZ  ,  Z  includes  all  n  term  products  of  the  matrices  U(I+B) 
n      n   n 

and  D  in  which  the  products  have  the  same  number  of  U's  and  D's  and  the 
partial  prodducts  ail  have  the  numbers  of  U's  equal  to  or  greater  than 
the  number  of  D's.   The  communication  assumption  implies  that  for  n  suffi- 

A       *  ft  ft 

ciently  large,  Q  =  U  7.     where  Z  is  strictly  positive^   Thus  Q  has  a 
*    °  *    in     n       n  n 

strictly  positive  i  th  row  if  there  is  a  non  zero  entry  in  the  i  th  row 
of  U  and  an  i  th  row  of  O's  if  U  has  no  positive  entry  in  the  i  th  row. 
By  renumbering  states  if  necessary 

Q.-  ■ 


n    I  o  J 


where  X  »   0  and  square,  "  >>  0.   How  positive  operator  theory  {5,6j 

implies  that  X  has  a  positive  eigenvalue  a     and  a  positive  eigenvector 

ft  ft  ft         ft 

P  ,  .  Define  P  „  =  1/a  P  .  Y   .   P  „  >>  0  and  the  vector 
n.l  n,2      n  nsi  n     n,/_ 

ft    ft    ft  ft 

P  =  ?  ,  ,P   ,  is  a  positive  eigenvector  for  Q  for  eigenvalue  a  . 
n    n,l'  n,2      r  'n       °        n 

ft 
Let  the  limit  of  Q  as  n  goes  to  infinity  be 


0*=   lX  Y 

I  G  j 


* 

with  P  and  a  the  positive  eigenvector  and  eigenvalue.   Again  from  positive 

ft 
operator  theory  the  powers  1/aQ 


(l/aQ*)j  = 


(l/aX)j  (l/aX)j":L(l/aY)! 

0         J 


i  * 

The  powers  (1/aX)   converge  to  a  matrix  of  the  form  WP„  where  XW  =  aW.   Thus 

(l/aX)-*"1(l/aY)  converges  to  W(P  (1/aY)}  =  WP_  and  (1/ctQ  )3    converges  WP  . 


Since 


Q  *  (U+Q*2D) (-B"1) 


*  i  *  -1+1     2     *.  i+2 

0  -  (1/aQ  y   U  +  a(l/aQ  )J  HB  +  a  (1/aQ  )J  D 


In  the  limit  as  j  goes  to  infinity  the  powers  converge  to  the  common  limit. 
This  means  that  the  vector  ?  >>  0   and  a  >   0  satisfy 

(7)       ?  (U+a3+a2D)  *  0 

Moreover,  an  elementary  positive  operator  result  guarantees  that  since 

* 

Q  >  CL  and  Q  has  eigenvalue  I*,  the  eigenvalue  o.     <   T.      Thus  a  <   V.      By 
n    ti      n  n 

assumption  f  is  the  smallest  number  for  which  there  was  a  strictly  positive 

*        it  *   * 

vector  P  satisfying  this  equation  (5).  Thus  a   =  T.      Since  0  >_  0  ,  P  0  l_  P  Q  • 

For  large  n  this  implies  P  0  >_  TV   . 

To  continue,  it  is  necessary  to  show  that  this  inequality  is  an  equality. 
First,  since  P»0  and  FQ  =  FP,  T   is  the  largest  eigenvalue  of  0  in 
absolute  value.   For  any  non-negative  matrix  the  eigenvalue  of  largest  abso- 
lute value  is  some  non  negative  real  number  and  has  a  non-negative  eigen 
vector.  Let  these  be  F  and  W  for  0  as  an  operation  on  the  dual  space. 

Tl 

In  order  that 

P<P,W)  -  (PQj/W)  -  CP.QjW)  *   r(P,K) 

it  is  necessary  that  r  =  r  since  P>>0  and  W>0,  W  f  0  imply  (P,W)>0.   Since 
T  is  the  largest  eigenvalue,  if  0  is  irreducible,  the  inequality 
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ft  ft 

P  Q  >  TP  must  be  an  equalitv  [5].   If  Q  is  reducible,  examine  the 
n  —  n 

irreducible  matrix 

Qn  +  e(e/|P*|)LP* 

where  L  is  the  column  vector  of  l's  and  j  j  is  the  sum  of  the  absolute 
values  of  the  coordinates.   Moreover  this  positive  matrix  cannot  have  a 
largest  eigenvalue  which  exceeds  the  sura  of  the  two  largest  eigenvalues 
T  +  e«   Since 

P  {Q+e/|P  JLP*)  >  r?  +  ep"  -  <r+e)P 

ft 

the  vector  P  must  be  an  eigenvector  for  eigenvalue  T  +   e  for  the  perturbed 
matrix.   Thus 

P  (Q  +e/|p*|LP*)  =  (r+e)P 

Since  this  is  true  for  all  e  >  0,  letting  e  go  to  0  proves 
*      ft 

p  o   -  rp 

Since  P  must  be  an  eigenvector  of  Q  for  eigen  value  Ts  the  limit 

ft       ft  *  * 

of  P  (Q  ~Q  )  ■  0.   Since  Q  -  0  mu3t  be  non-negative  and  P  is  strictly 
n  n*            n    'n 

ft     *  ft 

positive,  P  (Q  -Q  )  approaches  0  implies  that  Q  approaches  Q  .   Thus 

*     ft      ft 

Q  has  the  same  limit  Q  as  0  and  P  =  P. 

^n        ,  n 

An  interesting  consequence  of  this  result  is  that  the  iterative  scheme 

will  converge  for  any  initial  matrix  Q'  which  is  non  negative  and  for  which 

PQ"*  <  TP.   For  such  a  matrix 
o  - 
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<r  >  o 

n  —  n 


and 


rp  >  pq' 

~   n 

In  the  limit  FP  >  PQ"  3nd  0'  >  Q  produce  a  contradiction  unless  limit 
—   n     n  —  n 

* 

PQ"  *  TP  and  then  limit  Q"  must  be  limit  Q  . 
ti  Ti  n 

Another  similar  consequence  is  that  if  Q"  is  any  non  negative  matrix 
which  satisfies 

(8)       Q"  =  (U-fQ"2D)  (-B"1} 


with  largest  eigenvalue  ce  <  T   then  0"  =  limit  0  «  limit  Q  .  The  iteration 

starting  from  Q  *  Q  merely  reproduces  Q"  and  Q  >_  Q  .   In  the  limit 

P  Q"  >  P  Q'  »  TP  shows  that  c  >  r.   Thus  a  *  r,   The  combination  of  Q"  >  Q 
—    n  —  — 

•A     *  * 

and  P  (Q  -Q  )  =  0  imply  that  Q  =  Q  .   Thus  there  is  a  unique  non  negative  Q 

with  largest  eigenvalue  <_  f  satisfying  (8). 

Another  important  property  of  this  process  is  that  QDI  *<  UL  vjhere  L  is 

*       * 

the  vector  of  1's,   Since  0  =»  0,  Q  DL  «=  0  <  UL.   In  general 

H>     "   O       — 

-UL  =  Q*BL  +  Q*2,  DL 
n      n-i 

Since  Q  >  0  ,  >  0 
n  —  *n-l  — 

-UL  <  Q  (BL-fO   .DL) 
—  n     n— x 

Since  BL  -  -UL  -  DL,  and  the  induction  hypothesis  that  0  _-.PL  _<  UL  imply 
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-UL  <  Q  (-UL-DL+UL) 
—  n 

or 


UL  >  QDL 

~  n 


If  in  the  limit  UL  >_  QDL  with  strict  inequality  in  some  coordinate  them  since 
P  »  0 

PUL  >  PQDL  *  FFDL 

This  contradicts 

0  -  P{U+rB+F2D)L  -  (l-F)P(UL-rDL) 

from  which  PUL  -  FPDL.   Thus  QDL  =  UL. 

This  iterative  scheme  produces  the  same  limit  as  iteration  (1) .   In 
previous  work  it  was  shown  that  iteration  1  converges  for  any  Z  for  which 
Z  >  -B  ~  and  ZDL  •  L.   From  the  current  iteration  define  Z"   by 

00 

Z'   =  I   (I+B+QD)n  "  -(B+QD)""1 
n=0 

Since  QDL  -  UL,  the  series  converges,  Moreover  UZ*  =  -U(B+QD)~  «  Q  and 
Z"  >_  -B  .   Finally 

-L  *  Z"(B+QI»L  *  Z'(-DL) 

and  Z'DL  =  L.   Thus  if  Z"*   is  used  as  the  initial  condition  for  (1)  the 
result  is  Z.   Convergence  is  immediate  since 

ZJ  *  -B-1  +  (-B-1)QDZ'  -  -B  +  (-B_1)(-I-BZ')  -  Z' 

Thus  the  two  processes  produce  identical  results. 
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Alternative  Iteration 

There  is  yet  another  iterative  process  which  can  be  used  to  compute 
the  ratio  matrix.  As  in  the  special  case  in  which  U  is  a  constant  times 
the  identity  [ij,  this  process  uses  aa  inversion.   The  iteration  is 


(9) 


Z  =  G 
o 


Z  ■  -(B+UZ  1B)~X 
n    v    n-1 


Starting  from  the  obvious  Z,  =■  ~B  '  >  Z  »  an  induction  proves  Z  >  Z  , 

1       —  o  n  ~  n-1 

>^  0.  In  addition,  Z  DL  =  0  <_  L}  Z  DL  <  L  is  needed  to  show  that  the  inverse 
exists  at  each  stage.  Combined  with  the  communication  assumption  this  guar- 
antees that  I  +  B  +  U2  D  >  0  and  (I+B+UZ  D)L  <_  L  -  DL  <_  L.   The  inequality 

must  be  strict  in  at  least  one   coordinate,  since  D  ^  0.   Thu6  I  +  B  +  UZ  D 

n 

is  the  transition  matrix  of  a  finite  state  Markov  chain  which  is  not  conser- 
vative.  Thus  the  matrix  powers  converge  to  0  so  that 

GO 

Z    . .   -  E   (I+B+UZ  D}"  -  -(B+UZ  D)""1 
nti  n  n 

n=0 


exists.   Since  Z  >  Z  .  -J  0,  0  >  0,  D  >  0 
n  —  n-1  —  -   —  ?   — 

UZ  ,D  <  UZ  D 
n-1  —   n 

(I+B+UZ  ,D)n  <  (I+B+UZ  D)n  for  all  n 
n-1    —        n 

and  Z  ,_  >  Z  .   Since  D  >  0,  Z  _D  >  Z  D  and  0  <  Z  DL  <  L,  the  entries  in 
n+1  —  n  —     n-H  —  n       —  n   —  ' 

Z  D  form  monotonic  nondecreasing  sequences  bounded  by  1.   Thus  Z  D  con- 
verges, and  this  implies  that  B  +  UZ  D  or  ~Z~   converge,   This  in  turn 

n       n+i. 

implies  the  convergence  of  Z  to  a  matrix  Z. 
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An  obvious  question  is  whether  this  process  converges  to  the  limit  of 
the  previous  process.   Using  P,  F,  Q  from  the  previous  section  define  Z  by 


n 


-Z    «  E  +  QD 


-Z  ~t   -  B  +  UZ  D 
n+I        n 


First  PC-Z*"1)  -  F(B+QB)  •  P(B+rD)  -  -P(l/ru).  Since  QDL  -  UL,  f-Z*"1)-1 
I  l 

exists  and  FP  -  PUZ  ",   Assuming  UZ  DL  =  UL,  -Z  7,  L  -  -BL  and  (1+B+UZ  D)L  <  L 

1  n  n+1  n    — 

with  strict  inequality  in  at  least  one  coordinate.  Thus 

>» 

I      (I+B+UZ  d)n   =  -(B+UZ  B)"1  -  Z* 
A       n  "  n        n+i. 

n=0 

exists.  Moreover  L  =  Z  ^.DL  and  UL  =  UZ  ,,DL.   In  addition  assume  TV   «  PUz'* 

n+x  n+i  n 

P(-Z"~^"}  *  P(B+UZ*D)  »  P(B+PD)  ■  -I/FPU 
and 

rp  *  puz  . , 

n+1 

Finally  -Z,   >  -zT1  or  Z*  >  Z,  and  inductively  Z  >  Z  implies  -2  7,  > 
'   1   —   jl      1—1  n  —  n   "       n+1  — 

-Z"*  or  Z*   >  ?.  n,   Thus  PUZ  <  PUZ  =  FP.   The  limit  does  not  reverse 
n+1     n+1  —  n+1  n  —    a 

the  inequality.  Thus  by  the  last  section,  the  process 

Q   *  UZ 
o 


ft*         As:"?       —1 

Q  ■  (U+Q   B)(-B  ) 

n       n 

must  converge  to  Q.   The  convergence  is  immediate  since  the  limit  Z  satisfies 


UZUZD  «  -U-UZE 
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or, 

q^   =  -(U+U2U2DX-B""'")  -  (~UZB)(-B  )  «  UZ 

Thus  Q  -  UZ. 

The  difference  between  the  iteration  schemes  is  the  rate  at  which  they 
collect  the  required  products  of  powers  of  U,  I  +  B  and  D.   The  alternative 
process  increases  the  number  of  these  more  rapidly  but  at  a  cost  of  an  inver- 
sion. Moreover  Z  >>  0  but  Q  has  rows  of  O's  in  rows  in  which  U  has  rows  of 
O's.   Thus  the  previous  iteration  can  more  effectively  use  special  rapid 
matrix  multiplication  to  reduce  calculation  time.   Which  should  be  used 
probably  depends  on  the  specific  forms  of  U,  B  and  D, 

Although  the  monotonicity  is  lost  there  may  be  an  advantage  to  starting 

**  7V7V 

this  alternative  iteration  with  any  Z   >  0  for  which  Z  DL  m   L.   In  particular 

o  ~  o 

*-l        * 

such  a  matrix  can  be  formed  as  -B    where  B  ■  B  plus  a  matrix  which. is 

0  except  for  diagonal  entries  which  are  the  coordinates  of  UL.   Probabi- 
listically this  modification  is  to  ignore  possible  moves  to  the  higher 
states.   It  makes  the  iterative  process  for  M/M/i  converge  in  one  step. 
Unfortunately  this  improvement  is  the  exception  not  the  rule. 

Starting  from  Z   inductively  -Z      "   >  ~Z~~   and  2   >   Z    ,     Moreover 
o  '    n   —   n       n  —  n 

-Z         L  «  (B+UZ  nD)L  »  -DL 
n  n-1 

A*         *-.£  •$ 
and  as  before  the  inverse  Z   *  I (I-Z   }^  exists  and 

n        n 

L=Z  DL 
n 
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Since  Z   >  Z  ,  UZ  D  -  UZ  B  >  0.   Combining  this  with  L  »  0  and  U2  DL 
n  —  n'   n      n  —  n 

converging  to  UL  gives  U(Z  D~Z  D)L  converging  to  0.   This  means  that  UZ  D 
°nn         o«  n 

and  UZ  D  converge  to  the  same  limit.   From  this  the  limits  of  -Z   ~  and 
n       c  n 

„X  ** 

-Z   are  the  same:  as  are  those  of  Z   and  Z  . 
n  n       n 

Approximate  Inverse 


Some  time  ago.  using  an  elimination  procedure  for  the  inverse  in 
solving  the  matrix  quadratic  equation,  difficulties  were  experienced  with 
the  code  and  an  iterative  inversion  was  substituted.   The  result  was  very 
rapid  convergence  on  all  problems,   The  iterative  process  for  finding  A  , 

A  »  (2I+A  .,A)A  . 
n       n-1   n-1 

was  used  and  only  a  single  step  was  needed  for  adequate  accuracy.   This 
simple  combination  of  two  iterative  calculations  produces  a  single  iterative 
calculation.   Rather  than  treating  it  as  a  computer  approximation  to  the 
inverse  iteration  which  might  converge,  direct  analysis  can  establish  a 
much  stronger  result.   The  iteration 

(10)      1     -  (2I+Z  .(B-H5Z  ,B))Z  , 
%         n   •    n-1     n-1    n-1 

converges  if  Z  *  -B~  . 

The  justification  is  based  on  an  induction  to  show  that 

Z  >  Z  .  >  0.  Using  Z    (B-HJZ  D)  >  -I 
n  —  n-i  —        -     vi  n   — 

Z1   -  (2I+(-B~1)(3+U(-3"1)D))(-B~1) 

.  -b"1  +  (-B"'1)U(-B~i)D(-B"1) 

>  Z 
—  o 


-1  A~ 


The  second  inequality  for  Z  is 

o 


Z  (B+UZ  D)  =  (-3~X)(B-fU(-B  X)D)  -  -I  +  (-B  1)U(-!3~1)D  >  -I. 


o  -    o 


In  both  cases  the  inequality  is  true  because  -B  J'5  U7  and  D  are  non-negative, 
In  the  general  situation 


Z  .,  =  (2I+Z  (B+UZ  D))Z 
n+i       nv    n    n 

-  Z  +  (I+Z  (B+UZ  D))Z  . 

•  n    -   n     n    n 

Since  Z  (B+UZ  D)  >  -I,  both  I  +  Z  (B+UZ  D)  >  0  and  Z   >  0  and  thus 
n     n   —   '  n     n   —       n  — 

Z  .,  >  Z   >  0.   Moreover  since 
n+1  —  n  — 

1     >  -jj"1  .  x(I+B)K  >  I, 
n  —  — 

Z     has  no  ncr-zero  ic    i.      Tims   if 

n 

21    -  7    (B+UZ  D)    >  I 

u  "  n       — 

with  strict  inequalif   in  any  location  Z  ,  has  at  least  one  entry  strictly 


n-ri 


greater  tb_n  an  entry  in  Z  .  Assuming 


Z  (B+UZ  D)  >  •  I, 

n     n 


rearranging  gives 


1  +  Z  (B+UZ  D)  >  0 
n  •    n   — 


which  impli2f 


(I+Z  (B+UZ  D))2  >  0, 
n     n  ' '  — 
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Expanding  the  square 


I  +  2Z  (3+UZ  D)  +  (Z  (3-HJZ  D))Z  >   0 
n     n       h     n     — 


or 


(11)      (Z  (B+UZ  D))   >  -2Z  (B+UZ  D)  -  I, 
n     n     —    n     n 


Now 


Z  ^  (3-HJZ  .,1))  -   (2I+Z  (B+UZ  D))Z      B  +  UZ  .,D   . 
n+1     n+1  n     n    n  n+1 

Using  the  non-negativity  of  the  first  bracket,  U,  D,  Z  ,,  and  Z  ,  >  Z 

n+1      n+1  —  n 

Z  ..(B+UZ  ..D)  >    (2I+Z  (B+UZ  D))Z      B  +  UZ  D 
n+1     n+1   —   v    n     n    n  n 

2Z  (B+UZ  D)  +  (Z  (B+UZ  D))Z, 
n "    r,     •  n     n 

Applying  (11)  gives 


Z  ^ (B+UZ  ,,B)  >  2Z  (B+UZ  D)  -  2Z  (B+UZ  D)  -  I  =  -I 
n+1     n+1   —   n     n      n     n 

and  the  induction  is  complete „ 

Next  again  by  induction  establish  Z  DL  <  L.   For  Z  this  is 
°  n   —         o 

(-B  )DL  _<  L.   This  is  necessary  from  the  communication  assumption  that 

the  probability  of  leaving  a  set  of  states  must  be  1  for  all  starting  states 


or, 


L  =   E   (I+B)(U+D)L  -  -B"1 (UL+DL) . 
n*0 


Since  U,  D5  and  Z  are  non  negative, 
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z   _,,D  =  ((2I+Z  (B+UZ  D))Z  D  <  22  D  +  Z  BZ  D. 
p.+i         n     n    n  ~   n     n  n 

From  this  assuming  Z  DL  <  L  and  Z  UL  <  0S 
°  n   —       n   — 

Z  ,,DL  <  2Z  DL  +  Z  BL  «  2Z  DL  -  Z  UL  -   Z  DL  <  2  DL  <  L 
n-fi   —   n      n       n      n      n   —  n   ~ 

and  the  induction  is  complete. 

Now  Z  D  >  0  and  Z  DL  <  L  implies  that  the  entries  in  Z  D  are 
n  — ■       n   —  n 

bounded  by  1.   The  bound  and  the  raonotonicity.  Z   >   Z   , ,  imply  that  the 

'  n  ~   n-J -     - 

sequence  Z  D  converges.   This  implies  that  B  +  UZ  D  converges.   Since 
n  n 

Z  DL  <  L  and  Z     >  0,  I  +  B  +  UZ  D  >  0  with  (I+B+UZ  D)L  <  L  -  DL  <  L 
n   —       n  —  n  —  n    — 

0  <  I  (I+B+UZ  D)K  =  -(B+UZ  D)   . 
—         n  n 

This  means  that 


Z  (B+UZ  D)  >  -I 
n     n   — 


implies 


-Z   >  (B+UZ  D)~~- 

n  — •      n 


or 


7,      <  -(B+UZ  D)   . 
n  —       n 

Thus  for  n  sufficiently  large,  Z  is  bounded  by  the  limit  on  the  right  and  the 

n 

sequence  Z  converges. 

n       & 

For  the  limit  Z  . 


(2T.+Z  (B+UZ  D)  >  I, 
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If  the  inequality  is  strict  in  any  coordinate  so  that 
(21+2  (B+UZ  D))  =  I  +  E 

CO  '       oo  '  ' 

with  E  >_  0, 

(2I+Z  (B+UZ  D))Z  «=  (I+E)Z  =  Z  +  EZ  . 
Since  2  >  I.  EZ  >  E.  which  contradicts  the  requirement  that  EZ  ~   0. 

CO     —  00     ~~  *  *  CO 

Thus , 

21  +  Z   (B+UZ  D)   =   I 


QQ    '  CO 


Z    (B+UZ  D)   -  -I 


TO  CO 


or 


and 

Z      <=  -(B+UZ  D)"1. 

cc  ^  Oft      ' 

Thus  Z  has  an  inverse  and 

00 

I  +  BZ  +  UZ  DZ  =  0 

CO  00    CO 

which  has  a  uniaue  solution  Z  >  0,  Z  DL  <  L,   Thus  this  iteration  also 

*  oo  —    ?    CO     — ■ 

converges  to  the  desired  Z  . 

As  with  the  previous  iterative  schemes,  -E  "  is  not  the  only  and  perhaps 
not  the  best  choice  of  Z  .   The  reauired  properties  are 

Z  >   I 

o  — 

Z  DL  <  L 
o   — 

Z  (B+UZ  D)  >  -I. 
o     o   — 
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Convergence  of  the  Chain 

The  analysis  of  the  quadratic  Matrix  equation  may  new  be  applied  to 
the  Markov  chain.  The  Markov  chain  is  ergodic  if  and  only  if  there  is  a 
smallest  V   <   1  and  a  vector  P  >>  0  satisfying 

F(u+rB+r2D)  *  o 

Such  a  P  and  V   imply  the  existence  of  Q  >_  0  with  largest  eigenvalue  T 
satisfying 

U  +  QB  +  Q^D  »  0 

A  positive  vector  for  eigenvalue  i  for  the  transition  operator  can  be 

defined  using  Q,   This  eigenvector  is  obtained  by  using  P.,.  ~  P.Q  to 

construct  a  truncated  Markov  chain  involving  the.  sets  of  states  from  0  to 
i.   The  transition  operator  is 


ui~l 

I  +  B 


QD, 


From  the  iterative  calculation  QD  has  a  positive  entry  in  -location  r,s  if 
state  i,r  communicates  with  iss  through  states  in  sets  with  higher  index 
values  than  i,   Thus  the  truncated  process  is  acyclic  because  the  original 
chain  is.   The  fact  that  the  truncated  operator  is  a  conservative  transition 
matrix  follows  from  the  fact  that  QD  ^  0  and  QDL  =  UL.   This  means  that 
(U+I+B+QD)L  *  L  and  the  row  sums  of  the  last  sub-matrix  row  of  the  truncated 


:Q- 


process  are  l!s.   Thus  the  matrix  is  a  conservative  transition  matrix  of  a 
finite  state  acyclic  chain  and  has  a  unique  eigenvector  for  eigenvalue  1. 
The  full  eigenvector  is  completed  by  using  P.  3  P.  ..  0  for  j  >  i»   The  re- 
suiting  vector  is  determined  only  up  to  a  scale  which  must  be  selected  so 
that  entries  in  the  vector  sum  to  i.  This  may  be  done  if  and  only  if  F  <  1. 
The  result  is  not  only  the  eigenvector  of  eigenvalue  1  but  also  the  limiting 
probabilities  for  the  Markov  chain,   The  limit  exists  whenever  a  positive 
eigenvector  with  coordinates  which  sum  to  1  can  be  constructed.   When  r  >_  1 
the  same  construction  produces  a  vector  which  cannot  be  normalized  to  have  a 
coordinate  sum  to  1.      Moreover  there  is  no  other  matrix  which  can  generate 
an  eigenvector  with  geometric  upper  tail-   From  previous  results  [4],  if 
a  limit  exists  for  the  Markov  chain  it  has  upper  tail  generalised  geometric 
structure.   Thus  when  V   >_  1  the  chain  is  null. 

Alternative  Convergence  Criterion 

Further  information  about  r  and  P  can  be  found  by  considering  the 
matrix 

T(F)  =  I  +  U  +  TB  +  ]'2D 

For  ail  1  in  the  interval  (0,1) »  T(F)  >  0.   The  only  possible  question 

occurs  for  the  diagonal  entries,  but  FB . .  >  E.,  for  F  >  0  and  B . ,  <  0  and 

33   ~     23  JJ  - 

1  +  B..  >  0  since  I  -*-  B  is  a  submatrix  of  a  transition  matrix.   For  0  <  F  <  1, 
32   ~  -  " 

k 
T(?)   has  ncn  zero  entries  everywhere  that  T(l)  has.   By  assumption  T  (1)  »   0 

k  k 

for  some  k,  and  this  implies  that  T  (F)  »   0  for  all  F  in  (0,11 .   Since  T  (F) 

is  strictly  positive  it  has  a  largest  positive  eigenvalue  y(T)   and  a  strictly 
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positive  left  eigenvector  P  and  strictly  positive  right  eigenvector  Wp. 
Since  T(F)  is  analytic  in  T,    the  eigenvalue  y(T)   is  analytic  in  T.      Since  T(l) 
is  assumed  to  have  row  sums  equal  to  1,   y(l)  =1.  As  F  approaches  05  T(T) 
approaches  I  t  U  >  I  which  implies  that  y(H  >_  1. 

To  examine  y(0  between  the  extremes  differentiate  Pr(T(r)-Y(F)I)Wr  =  0, 
Using  "  to  denote  differentiation  the  result  is 

o  *  Pr'(T(r)-Y(r)i)wY  +  Pr(T-(r)  -  Y'(r)i)wr  +  Pr(x(r)  -  Y(r)i)w^ 
since  PrfT(D-Y(r)i]  =  iT<r)-Y<r)i]wr  «=  0, 

o  =  ?r(T'(r)Y(r)i)wr  -  p^B+arD-Y'CODWj, 

At  T  «  1,  W„  becomes  the  vector  of  l's,  L,  and 

Y'CDP^  -  F-j^CB+arD)!  -  P1(-UL+DL) 

Since  P..  and  L  are  strictly  positive, 

Y*(l)  >  0  If  P1  UL  <  Px  DL 
Y'(l)  1  0  if  P^'L  >_  PXDL 

If  y'(D  >  0  there  must  be  a  T     <  1  for  which  y(V   )  -  1.  This  means  that 

Pr*(U+r*B+r*2D)  -  0 

If  Y^CD  <  °»  if  there  is  Tn  <  1,  there  is  a  second  value  r„  <  1  for  which 


Y(r2)  "  i. 


if  Y(rx)  «  Y(r2)  =  i,  rx  <  r2  <  i,  then 
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°      2  l2 

Qn  -  (u-%_p)  <-b  ) 

produces  a  bounded  sequence  of  matrices.  The  previous  arguments  provide 

Pr  Q   =  I\P_  ,  Q     <  ro  max  Pr   /Pr    <  »  and  Q   >  0  .  From  this 
T2xn     2  I"  '  xn,r,s  -  2      T2,s  T2,r        ^n    TJ 

sequence  a  convergent-  subsequence  may  be  selected  with  limit  Q   with 
Pp  Q  "  -  r2Pr  .  Furthermore  Qn  1  Q     ^  DL  >  QDL  -  UL 


**     ,   **2  x 
-0  BL  -  (U+Q  ,D)L 

Q  (+UL+DL)  -  UL  +  Q  f  DL 
n  n~i 

A* 

T  P   (+UL+DL)  -  Pr  UL  +  T,Pr  Q  .DL 
i.  1 2  l2  2 

r0  pr  ul  +  pr  (-uL+rPDL)  -  r.pr  o  dl 
2  r_     r^  2  r„  n-i 

Since  Pr  (U+r2B+r22D)  »  0,  (l~r2)Pr  (UL-rDL)  -  o 

** 

Pr  UL  -  PP  Q  .DL 
1  ~      i 2  ^"1 

For  the  limit 

Pr  UL  ■  Pr  Q  DL 

l2      :2 

** 
If  there  were  strict  inequality  in  any  coordinate  Q  DL  >_  UL  then  there  would 

•kit 

be  strict  inequality  for  PF  UL  >_  P„  Q  DL  and  a  contradiction. 

'2      "2 
Now  begin  the  alternative  iteration  with 


Z  -  ~(B-K}  D)   . 
o 
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Since 


Z*~\   •  -(B+Q*D)L  -  DL 


L  -  Z  DL 
o 


Thus  the  sequence 

Z*   »  -CB+UZ*  1D)"1 

A 

converge  to  a  limit.  Moreover  this  limit  has  the  property  Pr  UZ  *  F.P 

1  n 
assuming  T.  is  the  smallest  F  for  which  y(V)   -  1.  On  the  other  hand 

P  Z*"1  -  P  [-<B+Q*D)3 

!2  °     l2 


*-l   1 

P„  Z    «  ~  P„  U 

z.        2    2 


r.p„  »  p„  uz 

2  F2    F2  ° 


and  generally 


P  Z*"1  =  P   [-B+Z*  D) 


Pr  z*"1  -  Pr  B  -  r.pr  D  -  i-  pr  u 
r2  n    r2    2  r2   r2  r2 


and 


r2pr2  "  \KX 


This  is  a  contradiction  since  the  limit  would  have  two  strictly  positive 
eigenvectors  with  positive  eigenvalues  which  was  earlier  shown  impossible. 
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Since  there  can  only  be  one  T<1  for  which  y(0=1,  no  such  value  can  exist 
for  y'(1)  1  0  or  when  P-UL  >_  PjDL.  Thus  the  Markov  chain  has  a  limit  if  and 
only  if  PjUL  <  PjDL. 
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